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GROUP-GENDER-COMPOSITION  FACTORS  IN  SEX-ROLE  ATTITUDE  MEASUREMENT 


EXECUTIVE  SUMMARY 


Requirement : 

This  research  tested  the  effects  of  certain  gender-related  situational 
factors  on  soldier  response  to  sex-role  attitude  measures  and  examined  the 
generality  of  published  data  reporting  such  effects  with  college  students.  In 
particular,  the  study  attempted  to  provide  data  bearing  on  the  question  of 
whether  male-soldier  responses  to  surveys  concerning  the  role  of  women  in  the 
Army  are  affected  by  the  presence  of  members  of  the  opposite  sex  while  the 
questions  are  being  responded  to. 


Procedure: 

Two  experiments  were  conducted.  In  Experiment  I  (N=217)  male  and  female 
soldiers  completed  a  sex-role  attitude  scale  in  classrooms  (about  26  soldiers 
in  each  room)  in  which  the  proportion  of  soldiers  of  the  subjects'  own  sex  was 
either  100%  or  50%.  Half  of  the  single-sex  groups  were  proctored  by  a  male, 
and  half  by  a  female.  In  Experiment  II  ( N=398) ,  conducted  2  years  later, 
soldiers  completed  the  scale  in  classrooms  (about  24  in  each  room)  in  which  the 
proportions  were  100%,  75%,  50%,  and  25%.  At  each  level,  half  the  groups  were 
proctored  by  two  males,  and  half  were  proctored  by  two  females. 


Findings : 

In  both  experiments,  sex-role-egalitarianism  scores  were  lower  for  males 
than  for  females  (£  ^.001  in  each  case);  but  in  neither  experiment  was  the 
subject-sex  x  group-composition  interaction  or  any  of  the  other  effects 
significant. 


Utilization  of  Findings: 

For  the  time  being — and  until  additional  research  suggests  otherwise — 
surveys  of  soldier  attitude  on  the  role  of  women  in  the  Army  may  be  conducted 
without  great  concern  that  they  will  be  invalidated  by  the  kind  of  group- 
composition  factors  examined  here. 


GROUP-GENDER -COMPOSITION  FACTORS 
IN  SEX-ROLE  ATTITUDE  MEASUREMENT* 


About  15  years  ago  a  study  was  reported  (Shomer  &  Centers,  1970)  indi¬ 
cating  that  male  college  students  respond  differently  to  a  sex-role  attitude 
questionnaire  as  a  function  of  the  gender  composition  of  the  group  in  which 
the  questionnaire  is  administered.  In  that  experiment  214  male  and  female 
college  students  responded  to  two  sets  of  questions,  one  set  dealing  with 
sex-role  attitude  and  the  other  dealing  with  attitudes  concerning  various 
child-rearing  practices,  with  two  situational  factors  (sex  of  the  other  group 
members  and  sex  of  the  proctor)  systematically  varied.  Some  groups  consisted 
only  of  males,  some  consisted  only  of  females,  some  were  half-male  and  half¬ 
female,  and  some  were  all-male  or  all-female  except  for  a  single  member  of 
the  opposite  sex.  Analysis  of  the  data  indicated,  as  expected,  that  the 
independent  variables  had  affected  responses  to  the  two  sets  of  questions 
differently.  In  the  case  of  the  sex-role  attitude  measures  there  was — in 
addition  to  the  usual  effect  of  subject  sex  (males  less  egalitarian  on  this 
topic  than  females) — a  subject-sex  x  group-composition  Interaction:  For  male 
subjects  but  not  female  subjects,  egalitarianism  scores  were  higher  in 
mixed-sex  than  in  same-sex  groups.1  in  the  case  of  the  child-rearing  atti¬ 
tude  measures,  there  were  no  effects  at  all. 

*The  author  is  grateful  to  the  following  persons  who  read  and  provided 


critical  comments  on  an  earlier  draft  of  this  paper:  Mike  Fischl,  Steve 
Fugita,  William  Hay  thorn,  Douglas  Rachford,  and  Paul  Twohig. 


The  results  of  that  experiment  raise  an  interesting  methodological  ques¬ 
tion — one  that  has  Implications  concerning  the  validity  of  certain  kinds  of 
data  collected  by  the  Army  as  well  as  by  the  other  services  (and  indeed  by 
any  organization  that  is  traditionally  male).  The  question  is  this:  Are 
male-soldier  responses  to  questions  concerning  the  role  of  women  in  the  Army 
affected  by  the  physical  presence  of  other  people  in  the  room  while  the  ques¬ 
tions  are  being  responded  to — either  people  of  the  respondent's  own  sex  or 
people  of  the  opposite  sex?*  Based  on  the  results  of  the  above  study,  one 
might  predict  that  when  men  respond  to  sex-role  attitude  questions  in  the 
presence  of  other  men  there  is  a  tendency  for  these  men  to  make  their  respon¬ 
ses  more  traditional  than  would  have  been  the  case  if  they  had  been  alone 
when  they  responded  to  these  questions.  One  might  also  predict,  based  on  the 
same  results,  that  when  men  respond  to  such  questions  in  the  presence  of 
women  there  is  a  tendency  to*  those  men  to  make  their  responses  more  egalita¬ 
rian  than  would  have  been  Che  case  if  ihe>  had  responded  t*»  the  questions 
alone.  Each  of  these  predictions  is  possible,  although  they  aio  independent 
of  each  other,  and  neither  is  required  by  the  other.  Assume  for  the  momci. ». 
however,  that  at  least  one  of  these  predictions  (or  descriptions)  is  accurate 
and  that  the  presence  of  at  least  some  kinds  of  people — same  sex,  opposite 
sex,  or  possibly  both — biases  the  responses  male  soldiers  give  to  questions 
about  sex-role  attitudes.  Under  these  circumstances,  one  would  expect  ques¬ 
tionnaires  administered  in  combat  units,  which  are  usually  all  male,  to  show 
more  traditionality  with  regard  to  sex  role  attitude  than  questionnaires 
administered  in  other  units,  which  frequently  include  women  as  well  as  men 
— not  (or  not  necessarily)  because  combat  soldiers  are  more  traditional  in 


this  regard  than  other  soldiers  but  because  (or  at  least  partly  because)  they 
are  filling  out  the  questionnaires  under  conditions  that  tend  to  elicit  sex- 
role  traditionalism.  Similarly,  one  would  expect  questionnaires  administered 
in  other  (i.e.,  suppor t-type)  units  to  show  more  sex-role  egalitarianism  than 
questionnaires  administered  in  combat  units — again  not  (or  not  necessarily) 
because  support-type  soldiers  are  more  egalitarian  in  this  respect  than  com¬ 
bat  soldiers  but  because  (or  at  least  partly  because)  they  are  filling  out 
the  questionnaires  under  conditions  that  tend  to  elicit  sex-role  egalitarian¬ 
ism.  If  this  effect  is  real,  it  seems  likely  that  such  questionnaires  ad¬ 
ministered  to  soldiers  in  their  "natural"  settings  (i.e.,  all-male  groups  for 
combat  soldiers  and  mixed-sex  groups  for  other  soldiers)  will  misread  the 
degree  to  which  soldiers  in  these  groups  accept  or  do  not  accept  the  use  of 
women  in  traditionally-male  roles. 

The  primary  purpose  of  the  experiments  described  here  was  to  test  the 
generality  of  the  phenomenon  reported  by  Shomer  and  Centers  (1970)  by  repli¬ 
cating  the  study  some  ten  years  later  in  a  military  popula tion . ^  A  secondary 
purpose — if  the  original  results  could  be  replicated — was  to  enhance  the 
specification  (and  thus  the  understanding)  of  the  phenomenon  by  determining 
whether  the  effect  was  any  stronger  for  individuals  seated  in  close  physical 
proximity  to  persons  of  the  opposite  sex  or  whether  the  effect  was  independ¬ 
ent  of  physical  proximity. 


EXPERIMENT  I 


Me  thod 

At  a  relatively  large  Army  post  in  the  southern  part  of  the  United 
States,  51  male  and  56  female  soldiers  in  basic  training  (Replication  1)  and 
51  male  and  59  female  soldiers  in  Advanced  Individual  Training  (Replication 
2)  completed  a  questionnaire  under  one  of  two  (same-sex  vs  mixed-sex)  group- 
gender-composition  conditions.  In  each  replication,  subjects  were  first 
assembled  at  the  post  testing  center  and  from  there  were  taken  to  one  of  four 
rooms  that  were  being  used  for  the  experiment.^  In  the  case  of  the  men,  half 
were  taken  to  a  room  (room  1)  to  which  only  men  had  been  assigned,  while  the 
rest  were  taken  to  one  of  two  rooms  (rooms  2  and  3)  to  each  of  which  an 
approximately  equal  number  of  women  had  also  been  assigned.  The  case  of  the 
women  was  exactly  the  reverse:  Half  were  taken  to  a  room  (room  4)  to  which 
only  women  had  been  assigned,  while  half  were  taken  to  one  of  the  two  rooms 
(rooms  2  and  3)  to  each  of  which,  as  indicated  above,  an  approximately  equal 
number  of  men  had  also  been  assigned.  In  each  replication,  therefore,  there 
were  four  experimental  locations:  one  (room  1 )  in  which  the  questionnaire  was 
administered  only  to  men,  a  second  (room  4)  in  which  the  questionnaire  was 
administered  only  to  women,  and  two  others  (rooms  2  and  3)  in  each  of  which 
the  questionnaire  was  administered  to  an  approximately  equal  number  of  men 
and  women.  Each  replication  was  thus  a  2x2  (subject-sex  x  group-composition) 
be  tween-subjects  design,  with  subjects  randomly  assigned  within  sex  to  the 
various  conditions.  In  the  all-male  group  the  questionnaire  was  administered 
by  an  enlisted  man,  and  in  the  all-female  group  it  was  administered  by  an 
enlisted  woman.  In  one  of  the  two  mixed-sex  groups  it  was  administered  by  an 


enlisted  man,  and  in  the  other  It  was  administered  by  an  enlisted  woman. 

The  primary  dependent  variable  was  the  score  obtained  on  a  seven-item 
scale  (Cronbach  alpha  =.76)^  that  had  been  constructed  to  measure  attitude 
concerning  the  role  of  women  in  the  Army.  Other  dependent  variables 
consisted  of  measures  of  such  things  as  attitude  regarding  noncommissioned 
officers  (NCOs). 

Resul ts 

As  indicated  above,  the  variable  of  proctor  sex  was  not  combined  factori- 
ally  with  the  other  two  variables  but  was  instead  held  constant  (in  the  sin¬ 
gle-sex  condition)  or  varied  systematically  (in  the  mixed-sex  condition). 

The  effect  of  this  variable  in  the  latter  condition  was  examined  by  testing 
the  proctor-sex  x  subject-sex  interaction.  In  neither  replication  was  the 
effect  significant  (both  £s>.0S),  and  the  data  from  the  two  mixed-sex  condi¬ 
tions  were  combined.  In  each  replication,  the  subject's  score  on  this  scale 
was  computed  by  summing  his/her  score  on  the  seven  items  and  computing  the 
mean.  The  theoretical  range  was  from  0  to  6,  with  higher  scores  indicating 
greater  sex-role  egalitarianism.  In  replication  1,  mean  scores  for  the  men 
and  women  were  1.8  and  2.4  respectively;  and  the  difference  is  statistically 
significant  (F=23.78,  df«*l/103,  £<.001 ).  The  subject-sex  x  group-composition 
interaction  was  not  significant  (F<1),  nor  were  any  of  the  other  effects  (all 
ps>.05).  In  replication  2,  mean  scores  for  the  men  and  women  were  1.7  and 
2.4  respectively;  and  the  difference  is  again  statistically  significant 


(F*36.70,  df-1/106,  £<.001 ).  As  before,  the  subject-sex  x  group-composition 
interaction  was  not  significant  (F<1),  nor  were  any  of  the  other  effects  (all 
ps  >.05).  The  last  item  in  the  questionnaire  asked:  "While  filling  out  the 
questionnaire,  were  you  sitting  next  to  a  person  of  the  opposite  sex?"  (Yes/ 
No).  Analysis  of  the  yes-no  frequencies  in  the  various  conditions  revealed 
no  obvious  pattern  (ps  >.05).  The  results  of  this  first  experiment  thus 
failed  to  detect  the  phenomenon  reported  by  Shomer  and  Centers  (1970). 

EXPERIMENT  II 

Me  thod 

Two  years  later,  at  the  same  post  at  which  the  first  experiment  was  con¬ 
ducted,  a  second  effort  was  made  to  replicate  the  Shomer  and  Centers  (1970) 
results.  Serving  as  subjects  in  the  first  session  (Replication  1)  were  100 
male  and  91  female  soldiers  taking  Advanced  Individual  Training,  and  serving 
as  subjects  in  the  second  session  (Replication  2)  were  102  male  and  105 
female  soldiers  who  were  also  taking  Advanced  Individual  Training.  At  each 
session,  subjects  assembled  in  an  auditorium  where  they  were  randomly 
assigned  by  sex  to  experimental  conditions  in  accordance  with  the  require¬ 
ments  of  a  2x4x2  be tween- subjects  design  and  then  taken  to  one  of  five 
rooms  which  were  being  used  for  the  experiment.  Independent  variables 
were  (a)  sex  of  the  subject,  (b)  percentage  of  soldiers  in  the  subject's 
room  who  were  of  the  subject's  own  sex  (1002,  752,  502,  and  252),  and  (c) 
sex  of  the  two  proctors  who  administered  the  questionnaire  in  the  subject's 
room  (both  male  or  both  female).  For  each  replication  the  proportion  of  male 
and  female  subjects  in  the  various  rooms  was  as  follows:  Room  1  (1002  male), 
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Room  2  (75%  male  and  25%  female),  Room  3  (30%  male  and  50%  female),  Room  4 
(25%  male  and  75%  female),  and  Room  5  (100%  female).  The  number  of  subjects 
in  each  room  was  approximately  20  in  every  case;  and  at  each  level  of  group- 
gender-composition,  one  of  the  two  rooms  was  proctored  by  male  proctors  and 
the  other  was  proctored  by  female  proctors.  Altogether  there  were  four  male 
and  four  female  proctor  pairs;  and  for  the  second  session  (Replication  2)  the 
variable  of  proctor  identity  was  systematically  rotated  across  conditions. 

Again,  the  primary  dependent  variable  was  the  score  obtained  on  the 
sex-role  attitude  scale,  with  other  variables  consisting  of  measures  of  such 
things  as  expressed  willingness  to  volunteer  for  combat,  attitude  toward  Army 
life,  and  plans  for  staying  in  or  leaving  the  Army.  A  number  of  measures 
were  included  which  sought  to  tap  subjects'  feelings  of  pressure  (if  any)  to 
respond  differently  from  the  way  they  would  ordinarily  respond.  For  example, 
questions  were  included  that  asked  what  subjects  thought  about  the  value  of 
surveys  like  the  present  one,  the  extent  to  which  they  thought  subjects  would 
respond  honestly,  and  whether  there  were  any  questions  they  had  considered 
not  answering  honestly.  There  was  also  a  measure  of  social  desirability. 

Finally,  there  was  a  question  that  asked:  "Just  now,  while  filling  out  this 
questionnaire,  did  you  happen  to  be  sitting  next  to  someone  of  the  opposite 
sex?  (Yes/No). 

i 

Results 

During  the  two  years  following  the  first  experiment,  the  method  of 
scoring  the  sex-role  attitude  scale  was  revised  (primarily  by  dropping  one  of 
the  items  and  by  developing  a  set  of  weights  to  be  applied  to  the  individual 
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items),  and  scores  were  now  able  to  range  up  to  31.  The  replication  variable 
did  not  interact  with  any  of  the  other  variables  in  the  design  (all  ps>.05), 
and  the  data  for  the  two  replications  were  combined.  With  respect  to  sex- 
role  attitude,  mean  scores  for  men  and  women  were  16.4  and  19.7  respectively, 
and  the  difference  is  statistically  significant  (F-56.8,  df-1/382,  £<.001 ). 
The  subject-sex  x  group-composition  interaction  was  not  significant  (F<1), 
nor  were  any  of  the  other  effects  (all  ps>.05).  Examination  of  the  other 
variables  revealed  no  obvious  patterns.  The  results  of  this  second  experi¬ 
ment  thus  failed  to  detect  the  phenomenon  reported  by  Shomer  and  Centers 
(1970). 


DISCUSSION 

Why  did  the  interesting  pattern  reported  by  Shomer  and  Centers  (1970) 
fail  to  replicate  in  the  experiments  described  here?  One  possibility — which 
is  consistent  with  some  of  the  discussion  by  the  authors  of  that  report — is 
that  gender  was  not  as  salient  a  factor  in  these  experiments  as  they  were  in 
the  earlier  one.  Responses  to  relevant  questionnaire  items  confirmed  that 
subjects  were  at  least  aware  of  the  fact  that  there  were  or  were  not  members 
of  the  opposite  sex  in  their  rooms;  but  most  soldiers  were  in  uniform  when 
they  came  to  the  sessions,  and  it  is  possible  that  being  dressed  alike  and  in 
the  common  uniform  served  to  reduce  the  attention  that  subjects  paid  to  this 
fact.  A  second  possibility  is  that  the  effect  observed  by  Shomer  and  Centers, 
while  reliable  at  the  time,  is  no  longer  reliable  because  of  historical/ socie¬ 
tal  changes  that  have  taken  place  with  respect  to  attitudes  toward  women. 
Given,  however,  the  controversial  nature  of  some  of  the  topics  asked  about  in 
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the  questionnaire  (e.g.,  use  of  women  in  combat  roles)  and  the  fact  that  male 
and  female  soldiers  are  generally  recognized  as  differing  on  this  question,  it 
seems  unlikely  that  historical/ societal  factors  provide  a  sufficient  explana¬ 
tion.  A  third  possibility  is  that  subjects  in  the  recent  experiments  suffered 
from  what  Rosenberg  (1965)  called  "evaluation  apprehension"  and,  as  a  result, 
were  rendered  impervious  to  some  of  the  forces  usually  operating  in  a  situa¬ 
tion  of  this  sort.  Efforts  were  made  in  the  experiments  to  reduce  the  unnatu¬ 
ralness  of  what  the  subjects  were  being  asked  to  do,  but  just  how  successful 
these  efforts  were  is  not  known.  A  fourth  possibility,  which  requires  some 
assumptions  about  the  different  populations  represented  in  these  studies,  is 
that  the  kinds  of  people  (soldiers?  non-college  young  people?)  who  took  part 
in  the  recent  experiments  are  for  some  reason  less  susceptible  to  group-gen- 
der-composi tion  effects  than  the  kinds  of  people  (non-soldiers?  college  stu¬ 
dents?)  who  took  part  in  the  original  study.  ThiB  seems  unlikely,  but  we  have 
no  data  on  it  one  way  or  the  other.  A  fifth  possibility  focusses  on  the  dif¬ 
ferent  measures  of  sex-role  attitude  used  in  the  studies  and  suggests  that  the 
measures  used  in  the  recent  experiments  are  less  affected  by  normative  consid¬ 
erations  than  the  measures  used  in  the  original  study.  Among  the  items  used 
in  the  recent  experiments,  however,  are  several  that  are  similar  in  character 
to  those  used  in  the  original  study;  and  none  of  these  items  (even  when  exam¬ 
ined  singly)  showed  group-composition  effects.  A  sixth  possibility  is  simply 
that  there  is  no  effect  to  replicate — i.e.,  that  the  original  effect  was  not 
reliable.  In  this  connection,  it  should  be  noted  a)  that  the  effect  reported 


by  these  authors  was  different  in  pattern  from  the  one  they  originally  pre¬ 
dicted  and  b)  that  the  statistical  significance  of  the  reported  effect  was  not 
great  (.05>£>.01). 

Looking  back  over  the  results  of  these  two  experiments,  it  is  difficult 
to  avoid  concluding  that — at  least  for  soldiers  (or  soldiers  in  uniform)  —  the 
effect  reported  by  Shomer  and  Centers  (1970)  is  not  very  reliable  and,  if  it 
exists  at  all,  is  of  limited  scope.  (We  have  not  yet  tried  this  experiment 
with  soldiers  in  combat  units  although  wp  have  used  soldiers  who  were  undergo¬ 
ing  basic  training,  and  many  of  these  soldiers  were  expecting  eventually  to  be 
assigned  to  combat  units.)  For  the  time  being — and  until  additional  research 
on  the  topic  suggests  otherwise — there  seems  little  reason  to  be  concerned 
that  surveys  of  soldier  attitude  regarding  the  role  of  women  in  the  Army  will 
be  invalidated  by  the  kind  of  group-composition  factors  discussed  here. 


FOOTNOTES 


1.  As  indicated  above,  Shomer  and  Centers  (1970)  distinguish  several  kinds  of 
mixed-sex  groups  (e.g.,  groups  that  are  half-male/ half-female  and  groups  that 
are  all  male  except  for  a  single  female)  but  do  not  provide  the  statistics  to 
show  that  these  distinctions  are  reliable. 

2.  A  similar  question  could  be  asked  concerning  the  responses  from  women 
soldiers. 

3.  One  could  of  course  derive  such  predictions  theoretically  (cf.  Allport, 
1920;  Charters  &  Newcomb,  1958;  Jones  &  de Charms,  1957;  Gerard,  1961;  Kelley, 
H.  H.,  1952,  1955;  Lambert,  Libman,  &  Poser,  1960;  Merton  &  Rossi,  1957; 
Pettigrew,  1966;  Ruble  &  Higgins,  1976;  Shibutanl,  1955;  Strickland,  Jones,  & 
Smith,  1960;  Taylor  &  Fiske,  1978;  Zajonc,  1965). 

4.  The  replication  is  not  exact.  As  indicated  in  footnote  1,  Shomer  and 
Centers  (1970)  used  several  types  of  mixed-sex  groups  but  were  unable  to  dem¬ 
onstrate  empirically  that  these  wi thin-mixed-sex-group  distinctions  were 
valid.  What  seemed  Important  therefore  (especially  given  the  methodological 
focus  of  the  present  research  and  the  presumably  Infrequent  occurrence  in  the 
Army  of  some  of  these  types)  was  to  try  to  replicate  the  effect  (single-sex/ 
mixed-sex)  that  was  found  to  be  statistically  reliable  in  the  original  study. 

5.  The  soldiers  arrived  at  the  testing  center  in  platoons,  led  by  their  pla¬ 
toon  leader,  and  there  were  seated  in  an  auditorium — the  men  on  one  side  and 
the  women  on  the  other.  The  experimenter  told  the  soldiers  that  they  would  be 
filling  out  a  questionnaire  and  that  he  would  pass  out  cards  telling  them 
which  rooms  they  should  go  to.  Previously-trained  proctors  then  passed  out 
pre-randomized  cards  with  room  numbers  (plus  additional  numbers  and  letters, 


which  the  soldiers  were  told  to  ignore),  and  the  soldiers  were  asked  to  take 
the  top  card  in  the  stack  and  pass  the  stack  to  the  next  person  in  the  row. 
When  all  the  cards  had  been  passed  out,  the  proctor  for  room  1  held  up  a  large 
piece  of  white  cardboard  with  a  large  "1”  on  it  and  asked  that  the  soldiers 
going  to  room  "1“  follow  him.  This  procedure  was  repeated  with  the  other 
proctors.  When  the  soldiers  arrived  at  their  rooms,  the  cards  were  collected; 
and  later  inspection  of  these  cards  indicated  that  all  the  soldiers  had  gone 
to  the  rooms  to  which  they  had  been  (randomly)  assigned. 

6.  A  copy  of  the  scale  and  a  report  of  its  development  (including  information 
about  the  scale's  psychometric  properties)  is  available  from  the  author.  Two 
examples  of  items  from  the  scale  are  as  follows: 

The  Army's  mission  is  best  carried  out: 

a.  by  men  only 

b.  mostly  by  men,  with  some  women  in  support  roles. 

c.  mostly  by  men,  with  some  women  in  combat  as  well  as  support  roles. 

d.  equally  by  men  and  women. 

e.  mostly  by  women. 

Women  don't  make  good  bosses  at  work. 

a.  Strongly  agree 

b.  Somewhat  agree 

c.  No  opinion  at  all 

d.  Somewhat  disagree 


e.  Strongly  disagree 
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